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ON  MOTIVATING  THE  MITCHELL-TODD 
MODIFICATION  OF  KARMARKAR’S  ALGORITHM  FOR 
LP  PROBLEMS  WITH  FREE  VARIABLES1 

H.J.  Martinez2 


Abstract.  In  this  note,  we  first  observe  that  the  Morshedi-Tapia  in¬ 
terpretation  of  the  Karmarkar  algorithm  naturally  offers  an  extension 
of  the  Karmarkar  subproblem  scaling  to  problems  with  free  variables. 
We  then  note  that  this  extended  scaling  is  precisely  the  scaling  sug¬ 
gested  by  Mitchell  and  Todd  for  problems  with  free  variables.  Mitchell 
and  Todd  gave  no  motivation  for  or  justification  of  this  extended  scal¬ 
ing. 

Key  words.  Linear  programming,  Karmarkar’s  algorithm,  free  vari¬ 
ables. 


1.  Introduction 

Morshedi  and  Tapia  [Ref.  1]  argued  that  the  Karmarkar  algorithm  [Ref. 2]  for 
linear  programming  can  be  viewed  as  an  example  of  the  steepest  descent  method 
applied  to  the  equality  constrained  nonlinear  program  that  results  when  the  tech¬ 
nique  of  squared-slack  substitution  is  applied  to  the  Karmarkar  standard  form 
linear  program.  In  this  standard  form,  the  only  inequality  constraints  are  non¬ 
negativity  constraints  on  the  variables.  If  some  of  the  variables  are  allowed  to  be 
free,  then  the  technique  of  squared-slack  substitution  dictates  that  they  not  be 
replaced  by  squared  slacks. 

The  Morshedi-Tapia  steepest  descent  interpretation  of  the  Karmarkar  algo¬ 
rithm  naturally  speaks  to  this  more  general  problem.  In  fact,  it  says  that  the 
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2Professor,  Departamento  de  Mat.emat.icas,  Universidad  del  Valle,  A. A.  25360,  Cali,  Colom¬ 
bia,  and  Visiting  Scholar,  Department  of  Computational  &  Applied  Mathematics,  Rice  Univer¬ 
sity,  Houston,  Texas  77251-1892.  Partially  supported  by  COLCIENCIAS  CO:  1106-05-307-93 
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free  variables  should  be  assigned  a  scaling  of  one  and  the  remaining  variables  be 
assigned  the  scale  used  in  Karmakar’s  algorithm.  This  is  precisely  the  extended 
scaling  suggested  by  Mitchell  and  Todd  [Ref.3]  with  no  justification  (see  rescaled 
Problem  P ,  pg  32,  [Ref.3]). 

While  this  extension  of  the  Karmarkar  scaling  to  problems  with  free  vari¬ 
ables  is  not  difficult  to  conjecture  and  some  authors  consider  it  natural  without 
motivation,  it  is  satisfying  that  we  have  motivated  it  in  at  least  one  manner. 


2.  The  Morshedi-Tapia  Equivalence  Result 

Consider  the  Karmarkar  standard  form  linear  program 

minimize  cTx 

X 

subject,  to  Ax  =  0  (1) 

eTx  =  1 

x  >  0 

where  c,  e  =  (1, 1, . . . ,  1)T  €  Ru  and  A  €  Rmxu  (m  <  n). 

Morshedi  and  Tapia  [Ref.l]  use  the  technique  of  squared  slack  substitution  (in 
this  case  x  —  y2)  to  transform  the  linear  program  (1)  into  the  equality  constrained 
nonlinear  program 

minimize  cTy 2 

x,y 

subject,  to  Ay2  =  0  (2) 

eV  =  1 

x  =  v/2 

where  y 2  is  shorthand  notation  for  (y\,y\, . . . ,  y2)r  ■  Similarly,  y/x  will  denote  the 
corresponding  expresion. 

Then,  they  considered  the  method  of  weighted  2-norm  steepest  descent  (weighted 
gradient)  on  problem  (2).  Specifically,  for  a  given  iterate  x,  strictly  feasible  with 
respect  to  problem  (1),  they  let  y  =  y/x  and  Y  =  diay(y ),  and  considered  the 
following  (weighted  steepest  descent)  subproblem  arising  from  problem  (2) 
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minimize  cTY.s 

S 

subject  to  AYs  =  0  (3) 

eTY~ls  =  0 

WY-'sh  <  I 

where  6  is  appropriately  chosen  to  keep  strictly  positive  iterates. 

The  subsequent  //-iterate  is  obtained  as  y+  =  y  +  .s,  where  s  is  the  solution  of 
subproblem  (3).  The  subsequent  x-iterate  is  obtained  according  to  the  formula 

x+  =  Yy+/eTYy+.  (4) 

The  first  two  expressions  in  (3)  represent  Taylor  series  linearizations  of  the 
corresponding  quantities  in  (2).  The  third  one  is  also  a  linearization  of  the  corre¬ 
sponding  quantity  in  (2),  but  it  is  not  a.  Taylor  series  linearization.  The  inequality 
in  (3)  is  a  weighted  2-norm  steepest  descent  (weighted  gradient)  constraint.  Mor- 
shedi  and  Tapia  view  (4)  as  a  Taylor  series  linearization  of  the  squared  substitu¬ 
tion  defining  relation  x  =  y2  followed  by  a  normalization  (projection)  which  closes 
(restores  feasibility  to)  the  constraint  eTx  =  1.  This  is  important  because  any 
meaningful  extension  of  the  steepest  descent  method  to  problems  with  equality 
constraints  will  require  feasible  iterates. 

To  see  that  the  process  described  above  is  equivalent  to  the  Ka.rma.rkar  algo¬ 
rithm,  we  need  only  observe  that  the  change  of  variables  .s  =  Y s'  in  (3)  and  (4) 
leads  to 

minimize  cT  Ds' 

s' 

subject  to 


and 

,:+  =  (,:  +  s')/eT(x  +  .S')  (6) 

where  D  =  diag(x)  and  .s'  is  the  optimal  solution  of  (5).  Clearly,  these  are  the 
defining  relations  for  the  iterates  in  the  Karmarkar  algorithm. 


AD  s’  =  0  (5) 

eT.s'  =  0 

11*112  <  6. 
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3.  Natural  Scaling  for  Problem  with  Free  Variables 

Consider  the  following  free  variable  extension  of  problem  (1) 

minimize  cpxp  +  cTjX  j 

Xp,Xf 

subject  to  Axp  +  Fxf  =  0 

e?,xP  +  ercf  =  1 

Xp  >  0, 


(7) 


where  cp,  xp,  ep  =  (1,1,...,  1)T  6  R11,  cj,x.f,ej  =  (1,1,...,  1)T  €  Rr,  A  G  Rri 
and  F  e  Rmxr. 


The  Morshedi-Tapia  approach  gives  as  counterpart  to  (2) 

minimize  cpy2  +  cTfx  / 

y,xptXf 

subject,  to  Ay2  +  Fx,f  =  0  (8) 

etf  +  ejxf  =  1 

xp  =  ?/2; 

and  as  counterpart  to  (3) 

minimize  cj  Ysp  +  cj  .s  j 

sV’s.f 

subject  to  AYsp  +  Fsj  =  0  (-0 

epY~1sp  +  cj-sy  =  0 

r-siii+iMB  <  *2- 

As  was  the  case  in  Section  2,  it  is  possible  to  write  the  subproblem  (9)  in  a 
form  which  maintains  y,  the  slack  variable,  in  squared  form  only.  In  fact,  if  we 
make  the  transformation  sp  =  Ysp  and  write  D  =  diay(xp ),  (9)  becomes 

minimize  cp  Dsp  +  cj’.s  j 

sp'sf 

subject,  to  ADsp  +  Fsf  =  0  (^) 

cpsp  +  e/J*/  =  0 

IKII1  +  MII  <  * 

which  says  that  the  free  variables  should  be  assigned  a  scaling  of  one  and  the 
remaining  variables  be  assigned  the  scale  used  in  Karmakar’s  algorithm.  This  is 
precisely  the  scaling  used  by  Mitchell  and  Todd  in  their  modified  Karmarkar’s 


algorithm  for  LP  problems  with  free  variables  (see  rescaled  Problem  P ,  pg  32, 
[Ref.  3]). 

While  Mitchell  and  Todd  used  the  extended  scaling  motivated  above,  they 
actually  worked  with  a  slight  modification  of  problem  (10).  The  direction  ob¬ 
tained  from  their  modified  subproblem  has  nice  properties,  but  technically  it  is 
only  equivalent  to  the  extended  Karmarkar  direction  given  by  the  solution  of 
(10)  in  the  weak  sense  that  they  give  the  same  value  to  the  Karmarkar  potential 
function.  For  more  details  on  this  weak  equivalence  see  Gonzaga  [Ref.4]. 
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